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Providing Electronic Access to Consumer-Customized 
Nonverbal Information Regarding Products and Services 



TECHNICAL FIELD 

This invention relates to providing electronic access to consumer-customized 
nonverbal information regarding products and services, and may also relate to enabling 
collaborative shopping for products and services using a broadband medium such as the 
Internet. 

BACKGROUND 

Before purchasing merchandise, it is sometimes desirable and/or necessary for a 
consumer visiting a merchant to obtain feedback or approval from a third party remote to that 
merchant. Often, in seeking this feedback and/or approval, it is desirable to supplement a 
verbal description of the merchandise with non-verbal information that describes the product 
as it relates to the consumer. For instance, when shopping for clothing, a visual image 
significantly enhances a third party's understanding of the clothing and the appearance of the 
clothing when worn by the consumer (e.g., fit). 

Conventionally, catalogs have been used to provide generic information for products 
and services offered by merchants. In a similar vain, merchant web sites recently have been 
used to store and reproduce online catalogs consisting of generic product descriptions for 
persons accessing the Internet. While helpful in gaining a general understanding of the 
products and services offered by a merchant, these catalogs do not relate products and 
services to any particular consumer, verbally or visually. Rather, they relate the products and 
services of a merchant to models and staged sets that leave the consumer to wonder how well 
the product or service will satisfy their needs. 

For a third party to obtain nonverbal information that relates the sought-after product 
or service to the consumer, the third party must resort to other means. For instance, in the 
clothing example provided above, for a third party to obtain non-verbal information that 
relates the clothing to a consumer seeking their feedback and/or approval, the third party has 
generally had to accompany the consumer to the merchant and observe the consumer being 
fit with the clothing. 
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SUMMARY 

Rather than requiring third parties to personally visit the merchant, real time or stored 
nonverbal information that conforms to consumer specifications is collected by a merchant 
and made electronically available to third parties remote to the merchant. Wired or wireless 
5 networking systems enable electronic communications between merchant and third party 
systems. 

In this manner, the generic information provided by printed and online catalogs may 
be supplemented or replaced by information that is customized for or related to the consumer, 
enabling a third party to more fully understand the purchase decision and thus offer more 
10 informed feedback. 

These concepts find particularly utility for merchants offering goods and services 
whose sale is premised on visual appearances. They may be used to reduce cycle time, 
increase market reach, enhance product exposure, and elevate the consumer excitement level 
to increase the likelihood of ultimate purchase. They also are used to establish an enduing 
21 5 record of transactions to enable future comparisons. 

■ J The details of one or more implementations are set forth in the accompanying 

drawings and the description below. Other features and advantages will become apparent 
MJ from the description and drawings, and from the claims. 

[SO BRIEF DESCRIPTION OF THE DRAWINGS 

5 Fig. 1 shows an example of a system capable of providing consumer-customized 

I f nonverbal information to a party accessing a merchant system; 

Fig. 1 A shows an example of components within the remote user and/or merchant 
computer systems of Fig. 1; 
25 Fig. IB shows an example of the merchant computer system of Fig. 1 ; 

Fig. 2 shows an example overview of a process for providing consumer-customized 
nonverbal information to a party accessing a merchant system from the perspective of a 
consumer; 

Fig. 3 shows an example overview of a process for providing consumer-customized 
30 nonverbal information to a party accessing a merchant system from the perspective of a 
merchant; 
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Fig. 3 A shows a sample record relating consumer-customized nonverbal information 
to identifying information and/or notes; 

Fig. 3B shows an example of a process for enabling access to consumer-customized 
nonverbal information; and 
5 Fig. 3C shows an example of screen used to display consumer-customized nonverbal 

information. 

Like reference symbols in the various drawings indicate like elements. 

DETAILED DESCRIPTION 

Referring to Fig. 1, a system 100 capable of providing consumer-customized 
1 0 nonverbal information generally includes input equipment 110, merchant computer system 
120, remote user computer system 130, and network 140. 

Input equipment 110 and merchant computer system 120 collectively gather 
C : merchandise information and make that information available to parties accessing the 
y; merchant computer system 120. The merchandise information may include consumer- 
Vi5 customized nonverbal information, e.g., nonverbal information describing merchandise 
If! arranged or configured as specified by the consumer. In one particular example, the 
i consumer-customized nonverbal information includes clothing being modeled by the 
: consumer or by some other person of the consumer's choosing. In another particular example, 

f 1J the consumer-customized nonverbal information includes tools or equipment arranged as 
" SO specified by the consumer to demonstrate their utility or adaptability. 
O Input equipment 1 1 0 and merchant computer system 1 20 may be operated 

independently in which case information collected by input equipment 1 10 is merely 
communicated to merchant computer system 120. Alternatively, input equipment 110 may 
be operated in conjunction with merchant computer system 120 to collect and communicate 
25 input from the consumer in response to requests received from merchant computer system 
120. 

More specifically, input equipment 110 generally includes equipment capable of 
collecting audio, video and other input from a consumer (hereinafter "primary consumer"). 
Input equipment 110 may include video or still camera equipment of digital type, but 
30 alternatively may include video or still camera equipment of the analog type accompanied 
with a digitizing device such as a digital scanner. In any case, the camera equipment is 
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generally capable of collecting full or partial length images and of manipulating collected 

images. Input equipment 110 may also include other standard input/output devices, such as, 

e.g., a microphone, and interfacing equipment. Where a video camera or microphone is used, 

a continuous stream of data may be communicated by input equipment 1 10 to merchant 

5 computer system 120. 

Merchant computer system 120 generally includes devices capable of soliciting, 

collecting and providing access to nonverbal consumer-customized information, consumer 

identification information and other related information (hereinafter "notes"), from input 

equipment 1 10 or otherwise. Examples of identification information include consumer 

10 name, billing and shipping addresses, telephone numbers, electronic mail (e-mail) address 

and passwords of at least the primary consumer, and examples of notes include image or 

merchandise description, merchandise price, and consumer comments. Merchant computer 

system 120 generally includes a personal computer, but may include an intranet with several 

iyi interconnected intelligent or dumb workstation terminals having simultaneous or shared 

?! 5 access to a central or distributed repository of data. In any case, merchant computer system 

120 includes a modem (e.g., standard, cable, digital subscriber line (DSL)) or other 

j| communication device to enable communications over network 140. 

m Remote user computer system 130 generally includes interfacing equipment capable 

M of enabling access to network 140 and thus merchant computer system 120, one or more 

^io output devices capable of enabling an operator of remote user computer system 130 

*¥; (hereinafter "secondary consumer") to perceive information, and input devices capable of 

|;3 communicating feedback from the secondary consumer to the primary consumer or merchant 

computer systems. Remote user computer system 130 generally includes a personal 

computer, an example of which will be described with respect to Fig. 1 A. Remote user 

25 computer system 130 may also include a wired or wireless information device such as a 

personal digital assistant (PDA) or web-enabled telephone. 

Network 140 enables electronic communications between merchant computer system 

120 and remote user computer systems 130. Network 140 may be wired or wireless. It 120 

generally includes a computer network, e.g., a wide area network (WAN) such as the 

30 Internet, or local area network (LAN). Network 140 may also or alternatively include other 

networks such as the plain old telephone system (POTS) network. Through network 140, 

one or more remote user computer systems 130 may gain access to information within the 
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merchant computer system 120, and may communicate feedback to the consumer or 
merchant computer system 120. 

Although not shown, a second network and corresponding interfacing equipment may 
be used to enable the primary consumer or merchant to notify the secondary consumer of 
information to be accessed at the merchant computer system 120. For instance, a plain old 
telephone system (POTS) may be used to enable the primary consumer and/or merchant to 
request feedback from a secondary consumer, or to notify the secondary consumer of 
consumer-customized nonverbal information that is available for downloading or streaming. 
In another example, merchant computer system 120 may include equipment or software (e.g., 
automated telephone equipment, instant messaging software, and/or email software) to 
enable automatic or manual notification. Correspondingly, remote user computer system 130 
may include equipment or software to enable perception of the notification, delayed or 
immediate feedback to the notification, delayed or immediate access to the referenced 
information, and feedback regarding that referenced information. 

Referring to Fig. 1 A, a computer system 160 represents an example of a hardware 
setup for executing software that allows a user to perform tasks such as communicating with 
other computer users, accessing various computer resources, and viewing, creating, or 
otherwise manipulating electronic content — that is, any combination of text, images, movies, 
music or other sounds, animations, 3D virtual worlds, and links to other objects. The 
computer system 160 of Fig. 1A may also be programmed with computer-readable 
instructions to enable content to be perceived (e.g., viewed) without being captured (e.g., 
copied, saved, or printed). 

The system 160 includes various input/output (I/O) devices 161 and a general purpose 
computer 162. I/O devices 161 may include mouse 161 A, keyboard 161B, and display 161 C, 
as shown, and may also or alternatively include other devices such as touch screens, video 
cameras, microphones, scanners, printers, wired or wireless devices (e.g., cellular telephone, 
personal digital assistant (PDA) or appliance). General purpose computer 162 may include 
central processor unit (CPU) 162 A, I/O unit 162B and memory 162C that stores data and 
various programs such as operating system 162C-1 and one or more application programs 
16C-2. The computer system 160 preferably also includes some sort of communications card 
or device 163 (for example, a modem or network adapter) for exchanging data with network 
164 via communications link 165 (e.g., a telephone line). 
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Referring to Fig. IB, a combination of more than one computer system may be used 
to implement merchant computer system 120. For instance, merchant computer system 120 
may include computer 122 and computer 124. Computers 122 and 124 may by physically 
5 independent, communicating by physical communications link 126, and requiring 

implementation on independent devices. Conversely, computers 122 and 124 may share 
devices, such that their independence is virtual and the communications link 126 
interconnecting those computers is implemented through software. Either or both of 
computers 122 and 124 may be implemented using devices such as those shown by Fig. 1 A. 
10 Computer 122 is generally a merchant host computer, providing an interface for 

remote users 130 to perceive when communications are enabled through network 140. For 
instance, computer 122 may include software or links to software enabling web page access 
and/or search functionality. More specifically, computer 122 may store or access and display 
a screen that includes an embedded link to a search program capable of searching and 
% 4 5 retrieving information from within computer 124. The screen may result from code written 
v |j in any of various languages, such as hypertext markup language (HTML), standard generated 
*y markup language (SGML), extensible hypertext markup language (XHTML), extensible 
i y markup language (XML), or otherwise. 

J , Computer 124 generally includes software for generating, storing and accessing 

f t>0 records relating consumer-customized nonverbal information to consumer identifying 
j; information and notes. The software stored on computer 124 typically includes a relational 
M database that stores records including related consumer-customized nonverbal information, 

identifying information for the primary consumer, and notes. Software 128 also may be used 
to control input equipment 110 and/or to integrate identifying information and notes entered 
25 at computer 124 with input received from input equipment 110. One example of the 

aforementioned software includes the Filemaker™ program equipped with a Troy™ plug-in 
module. Using this software, computer 124 can be used to control input equipment 1 10, to 
collect information from the primary consumer regarding images and other information 
collected by input equipment 1 10, to create records combining the related information to be 
30 stored and/or streamed, and to collect feedback from the secondary consumer when received. 
Additional integrating software may also be incorporated into computer 124 to 
automate the notification process based on information collected from the primary consumer 
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regarding the secondary consumer. For instance, if instant messaging or electronic mail 
software is installed on or accessible to computer 124, computer 124 may be configured to 
automatically send an instant message or email to the secondary consumer when an instant 
messaging or email address for the secondary consumer is entered by the primary consumer. 
5 As such, the identifying information collected from the primary consumer and related to the 
record or data stream may include identifying information for the secondary consumer, such 
as an instant messaging address, email address and/or telephone number. The instant 
message or email may be sent immediately upon entry of the address for the secondary 
consumer, or it may be sent at some later time as instructed by the primary consumer. 
10 Similar software may also be stored on computer 124 to enable notification of 

feedback from secondary consumer to the primary consumer and/or merchant. In this 
manner, the primary consumer may make a prompt purchasing decision once feedback is 
received, or the merchant may expedite processing of an order once authorization is received 
M3 from the secondary consumer. For instance, where the primary consumer provides standing 
III 5 instructions indicating that the purchase may be completed upon authorization or approval of 
"i the secondary consumer, processing of the purchase may be expedited through 
v3 communication of that authorization or approval to the merchant. In this case, the request for 
*' w feedback may include a request for payment information from the secondary consumer to 
lf[ enable a purchase. 

ff 0 Implementing merchant computer system 120 using more than one computer, 

2! whether physical or virtual, allows the merchant the flexibility to inhibit access to the 

13 consumer-customized nonverbal data without inhibiting access to the merchant web page, 
thus enhancing security and flexibility. 

Referring to Fig. 2, an exemplary process 200 perceived and performed by consumers 
25 includes several general steps. After the primary consumer selects merchandise of interest 
(step 210), the merchandise is arranged and/or configured according to primary consumer 
specification (step 230), and still or video images are obtained of the consumer-customized 
arrangement or configuration of merchandise (step 240). For instance, where a consumer is 
shopping for clothing, the clothing that is selected (step 210) may be modeled by the 
30 consumer or another consumer-selected individual (step 230), and an image of the clothing 
being modeled may be obtained by the merchant (step 240). 
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The primary consumer or merchant may attempt to contact the secondary consumer at 
various times throughout this process. For instance, as shown by step 220, an attempt may be 
made before the merchandise is configured according to consumer specification (step 230) 
and before consumer-customized nonverbal information is collected (step 240), allowing the 
5 secondary consumer to receive streaming of information substantially in real-time. However, 
an attempt also may be made after either of steps 230 and 240 to enable viewing of stored 
images or data streams. In any case, to make such an attempt, a standard or cellular 
telephone, instant messaging, email or some other means may be used. 

Once a digital image or stream of the consumer-customized arrangement or 
1 0 configuration of merchandise has been obtained, the secondary consumer may perceive the 
image or stream (step 250), and may provide feedback generally in the form of comments 
and/or authorization (step 260). Authorization may include payment information, 
# .» particularly where the secondary consumer is relied upon for purchasing decisions. 
%Q Finally, the feedback is registered and/or communicated to the primary consumer 

r|j5 and/or merchant. Thereafter, the purchase may be automatically enabled/refused, or the 
, 3 primary consumer may take additional steps to enable/refuse the purchase, e.g., with 

reference to registered feedback. 
I " Referring to Fig. 3, an exemplary process 300 perceived and performed by the 

I*; merchant includes several general steps. Images and other information are received from 
rf 0 input equipment 110, and related identifying information and notes are received from the 
|~ primary consumer (step 3 1 0). Where the images are obtained for future access, records that 
D relate the received images to identifying information and/or notes may be created and stored 

(step 320). Similarly, where a stream of images are obtained for future access, one or more 
records that relate the images within the stream to identifying information and/or notes may 
25 be created and stored (step 330). Fig. 3A illustrates a sample record reflecting the 
relationship established between images and identifying information and notes. 

However, where real-time access and viewing of the image, images or data stream is 
desired, it may be unnecessary to store the record and image(s) or data stream. In this 
instance, the identifying information may be stored merely to enable remotely-located 
30 secondary consumers to locate the image(s) or data stream for streaming, thus saving storage 
space. 
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Once records and/or data streams have been created based on the images and 
identifying information and/or notes, access is enabled for remote secondary consumers to 
the record or data stream, and thus the consumer-customized nonverbal information (step 
340). For instance, referring to Fig. 3B, merchant computer system 120 enables secondary 
5 consumers access to stored records or data streams through an interface to, e.g., computer 
322 of merchant computer system 120 (step 341). Identifying information or search criteria 
from the secondary consumer is then received, and a search is performed to identify a desired 
record or data stream using, e.g., an HTML page specified by searching software provided or 
accessed by computer 324 of merchant computer system 120 (step 342). Based on the search 
1 0 criteria, a search of available records and/or data streams is performed to return search 
results. When more than one record or data stream matches the received identifying 
information or search criteria (step 343), merchant computer system 120 prompts secondary 
consumer for additional information or selection among the identified records or data 
U3 streams, and receives this selection information or further search criteria to repeat steps 342 
; N 1 5 and 343 (step 344). When a record or data stream is ultimately identified by the secondary 
^ consumer, an authentication process may be performed to ensure that the primary consumer 
yi desires to enable access to this particular secondary consumer. For instance, a password or 

other information may be collected from the secondary consumer and compared with 
H ! information specified by the primary consumer. In this manner, different levels of security 
jr|>0 may be enabled to provide different secondary consumers with access to different images, 
i: Ultimately, for secondary consumers that are authenticated, records or data streams identified 
O are displayed or streamed, e.g., in the format shown by Fig. 3C. 

Based on the information accessed, feedback from the secondary consumer is 
received (350), communicated to the consumer, stored and/or used to authorize or disallow 
25 purchase of the merchandise (step 360). 

The systems and processes described above have particular utility in retail 
applications, where consumers sometimes prefer to compare the goods of one retail operation 
to the goods of another retail operation, and where enabling comparison of consumer- 
customized arrangements or configurations may be preferred. For instance, apparel, jewelry 
30 and other accessories are each items that consumers like to see customized to their choosing, 
e.g., by trying them on, before purchasing. The systems and processes may also find 

particular utility when used to display images or data streams to demonstrate services 
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available to meet consumer specifications. Furthermore, these systems and processes are 
useful where primary consumers seek feedback or are required to obtain authorization or 
payment approval for purchases from secondary consumers, e.g., in a guardian-minor and 
employer-employee relationships. 

A number of implementations have been described. Nevertheless, it will be 
understood that various modifications may be made without departing from the spirit and 
scope of the claimed invention. For example, although the terms primary and secondary 
consumer are used in the above description, they may be the same entity and either may be a 
non-consumer. More specifically, the secondary consumer may not be a consumer at all; 
they may instead be a third party to the transaction, merely providing feedback to the first 
consumer. Similarly, the primary consumer may be a third party to a transaction between the 
secondary consumer and the merchant, the primary consumer merely choosing items for 
review by the secondary consumer. Furthermore, the primary and secondary consumer may 
be the same entity. Still further, although the consumer-customized nonverbal information is 
described as being viewed from locations remote to a merchant site, this information may 
also be available for viewing at the merchant site (e.g., useful in comparing outfits during a 
fitting process, or at a later date), or at or in conjunction with other merchant sites. For 
instance, where several related merchants (e.g., by affiliation, location, product type) provide 
electronic access as described herein, the customer-customized nonverbal information for 
two or more of those merchants may be jointly displayed or linked. Accordingly, other 
implementations are within the scope of the following claims. 
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